Experiments  on  Dextrous  Manipulation 
Without  Prior  Object  Models 


Olac  Fuentes  and  Randal  C.  Nelson 

Technical  Report  606 
February  1996 


UNIVERSITY  OF 

ROCHESTER 


COMPUTER  SCIENCE 


Experiments  on  Dextrous  Manipulation  without 

Prior  Object  Models 

Olac  Fuentes  Randal  C.  Nelson 

The  University  of  Rochester 
Computer  Science  Department 
Rochester,  New  York  14627 

Technical  Report  606 

February  1996 


Abstract 

In  this  paper  we  present  a  kinematic  method  for  6-degree-of-freedom  manipulation  of 
rigid  objects  using  a  dextrous  robotic  hand.  Our  method  requires  no  prior  models  of  the 
objects  being  manipulated,  instead  it  obtains  all  the  information  needed  directly  from  the 
hand’s  sensors.  Its  low  computational  cost  makes  real-time  performance  easy  to  achieve. 

We  present  experimental  results  showing  the  implementation  of  our  method  using  the 
Utah/MIT  dextrous  hand.  We  also  show  that  adding  a  Cartesian  controller  significantly 
improves  the  accuracy  of  the  manipulation. 
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1  Introduction 


In  recent  years,  dextrous  robotic  manipulators  such  as  the  Salisbury  hand  [Salisbury,  1982] 
and  the  Utah/MIT  hand  [Jacobsen,  1984;  Jacobsen  et  al,  1986]  have  become  increasingly 
available  in  research  environments.  Dextrous  hands  offer  several  advantages  over  conven¬ 
tional  grippers.  They  provide  a  large  degree  of  versatility  for  fine  motions.  They  facilitate 
the  partition  of  manipulation  tasks  into  gross  and  fine  manipulation,  where  a  robot  arm  per¬ 
forms  gross  positioning  and  the  hand  handles  fine  manipulation.  They  allow  better  control 
of  gripping  forces.  Their  large  number  of  joints  allows  them  to  adapt  well  to  many  different 
shapes,  enabling  them  to  grasp  a  wider  variety  of  objects  than  conventional  grippers. 

In  spite  of  the  potential  advantages  of  dextrous  manipulators,  programming  them  to 
perform  useful  tasks  has  proven  to  be  a  very  challenging  task.  Their  relative  inaccuracy 
and  the  high-dimensionality  of  their  parameter  space  make  this  difficult. 

Most  research  on  dextrous  manipulation  has  focused  on  theoretical  analyses  of  grasping 
and  manipulation  tasks  assuming  an  idealized,  well-controlled  hand  and  complete  models 
of  the  objects  being  manipulated.  Following  this  line  of  research,  a  great  deal  of  progress 
has  been  made  in  understanding  the  nature  of  the  interactions  of  objects  and  multiple 
cooperating  robots  (see  e.g.  [Cutkosky,  1985;  Mason  and  Salisbury,  1985;  Murray  et  a/., 
1994]). 

Although  the  mechanics  of  manipulation  are  well-understood,  relatively  few  experimen¬ 
tal  systems  for  dextrous  manipulation  have  been  implemented  to  date,  and  most  of  these 
systems  either  have  been  hardwired  for  a  specific  application  or  strongly  relied  on  prior  ob¬ 
ject  models,  which  made  their  applicability  in  dynamic  and  unknown  environments  difficult. 
Michelman  and  Allen  [Michelman  and  Allen,  1993;  Michelman  and  Allen,  1994],  presented 
a  method  based  on  hybrid  control  for  dextrous  manipulation  using  the  Utah/MIT  hand. 
The  system  was  shown  to  work  for  several  manipulation  tasks,  such  as  removing  the  top  of 
a  child-proof  medicine  bottle,  using  a  limited  amount  of  prior  information  about  the  object. 
A  major  difficulty  was  the  unreliability  of  force  sensing.  Speeter  [Speeter,  1991]  proposed 
motor  primitives  for  the  Utah/MIT  hand.  Motor  primitives  are  sequences  of  joint  position 
changes  encoding  a  small  functional  motion  of  the  hand.  Although  motor  primitives  could 
be  combined  and  generalized  to  some  extent,  the  fact  that  they  were  specific  to  a  particular 
object  made  the  development  of  a  reasonably  useful  set  of  primitives  cumbersome. 

We  propose  a  non-model-based  approach  to  dextrous  manipulation.  Our  method  does 
not  require  any  prior  information  about  the  object;  all  the  required  information  can  be  read 
directly  from  the  hand’s  sensors.  The  method  allows  arbitrary  (within  the  robot’s  physical 
limits)  translations  and  rotations  of  the  object  being  grasped.  We  rely  on  the  compliance  of 
the  Utah/MIT  hand  to  maintain  a  stable  grasp  during  manipulation,  instead  of  attempting 
to  compute  analytically  the  required  forces. 

The  organization  of  the  remainder  of  this  paper  is  as  follows.  Section  2  describes  our 
dextrous  manipulation  method.  Section  3  presents  experimental  results  showing  a  quanti¬ 
tative  evaluation  of  the  precision  that  can  achieved  with  the  method,  and  noting  it  can  be 
further  improved  using  a  higher-level  controller.  Section  4  presents  conclusions  and  briefly 
describes  some  present  and  future  work. 
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Figure  1:  The  contact  tetrahedron  (a)  and  the  grasp  tetrahedron  (b). 


2  A  Non-Model-Based  Dextrous  Manipulation  Strategy 

We  assume  that  prior  to  manipulation  the  object  has  been  stably  grasped.  The  basic 
idea  of  our  technique  is  based  on  the  observation  that  the  commanded  fingertip  positions  or 
setpoints  define  a  rigid  object  in  three-dimensional  space,  in  this  case  a  (possibly  degenerate) 
tetrahedron.  We  refer  to  this  object  as  the  grasp  tetrahedron.  The  contact  points  of  the 
fingers  on  the  ol)ject  define  another  object  that  we  refer  to  as  the  contact  tetrahedron. 
Because  of  t  he  compliant  control  system,  we  can  model  the  statics  of  the  situation  by 
regarding  each  verte.x  of  the  contact  tetrahedron  as  being  attached  to  the  corresponding 
vertex  of  the  gras])  tet  rahedron  by  a  virtual  spring.  In  the  case  of  an  object  free  to  move,  net 
wrench  is  const  rainetl  to  be  zero.  Moreover,  for  a  well  conditioned  grasp,  the  wrench  zero 
coincides  with  a  deei)  local  minimum  of  the  spring  energy  function  on  a  manifold  defined  by 
the  rigid  di.s[)lacemenls  of  the  grasp  tetrahedron  with  respect  to  the  contact  tetrahedron. 
This  means  tlial  if  wo  treat  the  fingertip  contacts  as  fixed  points  on  the  object,  then  the 
object  can  bo  rotated  and  translated  by  executing  the  desired  rigid  transformation  on  the 
grasp  totrahodron.  Iti  other  words,  displace  the  grasp  tetrahedron  and  the  object  will 
follow.  Although,  tliio  to  non-zero  finger  size  and  other  effects,  the  assumption  of  fixed 
contact  points  is  not  strictly  correct,  our  experimental  results  show  that  the  compliance  of 
the  Utali/MI'l  hand  compensates  for  the  errors  introduced  by  the  use  of  this  assumption. 
Somewhat  similar  tipproaches  have  been  suggested  in  [Okada,  1982]  and  [Salisbury  et  al., 
1989]. 

In  more  (h'tail.  tlie  formulation  is  as  follows.  Let  ^po,^Pi,^P2  and  be  the  fingertip 
to  object  contact  poitits,  where  ^pi  denotes  that  pi  is  being  measured  with  respect  to  a 
hand-centered  reference  frame  H.  Let  ^qo,^qi,^q2  and  be  the  commanded  finger¬ 
tip  positions  or  setpoints.  The  tetrahedron  ^Po,^Pu^P2^P3  is  the  contact  tetrahedron. 
^qo,^qu^q2’'q3  is  the  grasp  tetrahedron.  The  contact  and  grasp  tetrahedra  for  a  sample 
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Figure  2:  The  hand-centered  reference  frame  H  and  the  object-centered  reference  frame  C 


grasp  are  shown  in  figure  1.  If  the  object  is  stably  grasped,  the  grasp  tetrahedron  will  gener¬ 
ally  be  completely  contained  in  the  contact  tetrahedron.  The  locations  of  the  grasp  and  the 
contact  tetrahedra  can  be  obtained  respectively  from  the  measurements  of  the  commanded 
and  actual  joint  angles  and  the  forward  kinematics  of  the  hand. 

As  noted  above,  the  force  applied  to  the  object  at  any  of  the  contact  points  is  ap¬ 
proximately  proportional  to  the  diflFerence  between  the  fingertip’s  commanded  and  actual 
positions.  If  the  fingertip  positions  with  respect  to  the  object  remain  constant,  we  can  apply 
arbitrary  rotations  and  translations  to  the  object  while  keeping  a  constant  force  applied  in 
every  contact  point  by  just  rotating  and  translating  the  grasp  tetrahedron.  Formally,  we 
describe  the  situation  as  follows. 

Let  =  [cx^Cy^Cz'^  be  the  coordinates  of  the  centroid  of  the  grasp  tetrahedron  with 
respect  to  frame  H .  We  define  an  object-centered  frame  of  reference  C,  with  its  axes  parallel 
to  if’s  and  with  origin  at  c,  as  shown  in  figure  2. 

Given  the  manipulation  command  (x,  y,  a, /?,  7),  where  y  and  2:  represent  displace¬ 
ments  of  the  object  with  respect  to  its  initial  position  and  are  interpreted  as  sequential 

rotations  around  the  x,  y  and  2:  axes  of  C,  the  resulting  setpoints  •  •  •  7  ^3  given  by: 


^lix 

1 - 

1 

1 _ 

^iy 

=  T{{x,y,z,a,  /?,7)) 

Qiy  Cy 

^hz 

Qiz  ^z 

1 

1  J 
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Figure  3:  Translation  along  the  x  axis 


Where  T{{x,y,  z,a,/3,j))  is  given  by:  ^ 


cac(3 

sacP 

-sl3 

0 


casPsy  —  sacj  casiScj  +  sasj  x  + 
sasfisj  +  cacj  sasfScj  —  easy  y  +  Cy 
c^sy  cf3cy  z  +  Cz 

0  0  1 


3  Experimental  Results 

The  algorithm  described  in  the  previous  section  was  implemented  on  the  Utah/MIT  hand,  a 
16  degree-of-freedom  four-fingered  dextrous  manipulator.  Each  joint  of  the  hand  is  actuated 
by  a  pair  of  pneumatically-driven  antagonist  tendons.  This  results  in  a  compliant  response, 
but  it  also  makes  reliable  and  consistent  positioning  difficult  to  achieve  due  to  hysteresis 
and  friction  effects. 

Figures  3  to  8  show  the  hand  manipulating  a  wooden  block.  The  images  show  transla¬ 
tions  along  and  rotations  about  the  three  main  axes.  Although  we  only  show  the  results  of 
translations  and  rotations  orthogonal  to  the  main  axes,  translations  and  rotations  can  be 
performed  with  respect  to  any  arbitrary  axis. 


Sve  use  c9  and  s0  as  shorthand  for  cos{e)  and  sin{0),  respectively 
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Figure  5:  Translation  along  the  2  axis 
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Figure  7:  Rotation  about  the  y  axis 
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Figure  8:  Rotation  about  the  axis 


3.1  Performance  Evaluation 

We  evaluated  the  precision  obtained  by  comparing  the  commanded  and  an  estimated  posi¬ 
tion  and  orientation  of  the  object  during  a  manipulation  sequence.  To  estimate  the  actual 
configuration  of  the  object  we  define  an  object-centered  reference  frame  D  from  which  we 
can  later  obtain  the  estimated  {x^  y,  2:,  a,  /?,  7)  values.  Let  po^  •  • . ,  Ps  be  the  coordinates  of 
the  fingertips,  obtained  from  the  sensed  joint  angles  and  the  forward  kinematics  of  the  hand. 
Let  d  be  the  centroid  of  the  tetrahedron  formed  by  po?  •  •  -  jPs*  Let  Vij  denote  the  vector 
joining  pi  and  pj.  Then  is  given  by: 


H  rp 


..V.Q2  .  ^Q2X't^3I.>i^Q2  ^Q2-><.'^31  W 

b02|  |i^02X1'31  Xt'02|  |^^02Xt;3i| 

0  0  0  1 


That  is,  the  origin  of  D  is  the  centroid  of  the  contact  tetrahedron,  the  a:-axis  is  parallel  to 
the  line  joining  the  fingertips  of  the  thumb  and  the  index  finger,  the  jsr-axis  is  perpendicular 
to  the  a:-axis  and  to  the  line  joining  the  fingertips  of  the  index  and  ring  fingers,  and  the 
y-axis  is  perpendicular  to  the  x  and  z  axes. 

From  we  get  the  estimated  position  and  orientation  as  follows: 

X  =  p)T  14  y  ^  d'^‘2,4  Cy ^  Z  —  jyT '^4 

/?  =  Atan2{-^T3u  + 

a  =  Atan2{^T2i/ cos/?,^Tii/ cos/?), 
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Figure  10:  Control  system 


7  Atan2{^Tz2/  cos^,  ^^33/ cos/3), 

Figure  9  shows  a  comparison  of  the  estimated  and  commanded  positions  in  a  manipula¬ 
tion  sequence  using  our  strategy.  The  sequence  of  movements  consisted  of  rotations  of  35, 
-70  and  35  degrees  about  the  x  axes,  23  and  -46  and  23  degrees  about  the  y  axes,  and  45, 
-90  and  45  degrees  about  the  axis,  followed  by  translations  of  20,  -40  and  20  millimeters 
along  the  x  axes,  28,  -56  and  28  millimeters  along  the  y  axis,  and  13,  -26  and  13  millimeters 
along  the  z  axis.  These  ranges  we  determined  to  fall  within  the  physical  limit  of  the  hand. 
For  the  sequences  shown  in  figure  9,  the  root-mean-squared  error  was  3.63  mm  for  rotations 
and  6.72  degrees  for  translations.  It  can  be  seen  that  although  the  Utah/MIT  hand  is  a 
relatively  imprecise  and  difficult  to  control  manipulator,  due  to  hysteresis  and  friction,  a 
fairly  good  degree  of  precision  can  be  achieved.  In  the  next  subsection  we  will  discuss  how 
we  can  improve  upon  this  precision  by  adding  a  higher-level  Cartesian  controller. 

3.2  Addition  of  a  Cartesian  Controller 

At  the  low(*st  level,  each  joint  in  the  Utah/MIT  hand  is  controlled  using  a  standard  PD 
controlhu.  In  principle  the  joint  errors  can  be  reduced  by  increasing  the  gains  in  these 
controlhus.  However,  this  would  also  result  in  a  decrease  in  compliance 

A  way  to  reduce  position  errors  while  maintaining  compliance  is  to  implement  a  higher- 
level  (‘art('sian  controller  to  correct  errors  directly  in  the  6-dimensional  position-orientation 
spac(\  4  lu'  estimated  errors  in  (x,  y,  2:,  a, /?,  7)  were  fed  to  a  Cartesian  PID  controller,  as 
shown  in  li<iur(‘  10.  In  the  actual  implementation  we  substituted  summations  for  integrals 
and  first  difierfuices  for  derivatives.  We  performed  the  same  manipulation  sequence  as  in  the 
previous  subsf’ction.  The  resulting  improvement  in  performance  is  shown  in  figure  11.  For 
this  kind  of  control,  the  root-mean-squared  errors  were  reduced  to  1.1  mm  in  positioning 
and  1.9!>  deurc^es  in  orientation  during  the  sequence. 


4  Conclusions  and  Future  Work 

We  ha\’e  presented  experimental  results  demonstrating  the  efficacy  of  a  purely  kinematic 
technique  for  dextrous  manipulation  with  the  Utah/MIT  hand.  Although  the  Utah/MIT 
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Absolute  position  errors 


Absolute  orientation  errors 


Figure  11:  Commanded  (dotted  lines)  and  estimated  (solid  lines)  positions  and  orientations 
and  estimated  errors  during  a  manipulation  sequence. 


hand  is  very  difficult  to  control  due  to  the  high  dimensionality  of  its  parameter  space  and 
the  non-rigid  nature  of  its  actuators,  we  have  shown  that  fairly  precise  manipulation  can 
be  performed.  We  also  showed  that  the  addition  of  a  Cartesian  controller  further  improves 
the  precision  of  the  manipulation. 

In  contrast  to  most  previous  approaches  to  dextrous  manipulation,  our  method  is  com¬ 
pletely  model-free,  a  crucial  feature  for  use  in  dynamic  and  unknown  environments.  The 
relative  low  computational  cost  it  requires  makes  it  easy  to  implement  in  real-time. 

Current  and  future  work  includes  the  application  of  this  method  to  telemanipulation, 
where  instead  of  attempting  to  map  the  configuration  of  the  teleoperator’s  hand  directly  to 
the  robotic  hand,  the  teleoperator  uses  a  polhemus  or  similar  device  to  command  transla¬ 
tions  and  rotations  of  the  object.  We  are  also  working  on  the  combination  of  this  dextrous 
manipulation  technique  with  non-calibrated  visual  servoing  to  perform  high-precision  as¬ 
sembly  tasks. 
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